Social recommender systems (SocialRS) simultaneously leverage user-to-item interactions as well as user-to-user social relations for the task of generating item recommendations to users. Additionally exploiting social relations is clearly effective in understanding users' tastes due to the effects of homophily and social influence. For this reason, SocialRS has increasingly attracted attention. In particular, with the advance of Graph Neural Networks (GNN), many GNN-based SocialRS methods have been developed recently. Therefore, we conduct a comprehensive and systematic review of the literature on GNN-based SocialRS. In this survey, we first identify 80 papers on GNN-based SocialRS after annotating 2151 papers by following the PRISMA framework (Preferred Reporting Items for Systematic Reviews and Meta-Analysis). Then, we comprehensively review them in terms of their inputs and architectures to propose a novel taxonomy: (1) input taxonomy includes 5 groups of input type notations and 7 groups of input representation notations; (2) architecture taxonomy includes 8 groups of GNN encoder, 2 groups of decoder, and 12 groups of loss function notations. We classify the GNN-based SocialRS methods into several categories as per the taxonomy and describe their details. Furthermore, we summarize the benchmark datasets and metrics widely used to evaluate the GNN-based SocialRS methods. Finally, we conclude this survey by presenting some future research directions.

As multimodal learning finds applications in a wide variety of high-stakes societal tasks, investigating their robustness becomes important. Existing work has focused on understanding the robustness of vision-and-language models to imperceptible variations on benchmark tasks. In this work, we investigate the robustness of multimodal classifiers to cross-modal dilutions - a plausible variation. We develop a model that, given a multimodal (image + text) input, generates additional dilution text that (a) maintains relevance and topical coherence with the image and existing text, and (b) when added to the original text, leads to misclassification of the multimodal input. Via experiments on Crisis Humanitarianism and Sentiment Detection tasks, we find that the performance of task-specific fusion-based multimodal classifiers drops by 23.3% and 22.5%, respectively, in the presence of dilutions generated by our model. Metric-based comparisons with several baselines and human evaluations indicate that our dilutions show higher relevance and topical coherence, while simultaneously being more effective at demonstrating the brittleness of the multimodal classifiers. Our work aims to highlight and encourage further research on the robustness of deep multimodal models to realistic variations, especially in human-facing societal applications. The code and other resources are available at https://claws-lab.github.io/multimodal-robustness/.

基于会话的推荐系统（SBRS）表现出优于常规方法的性能。但是，它们在大规模工业数据集上显示出有限的可伸缩性，因为大多数模型都会学习一个嵌入每个项目。这导致了巨大的记忆要求（每项存储一个矢量），并且在稀疏的会话上具有冷启动或不受欢迎的项目的性能差。使用一个公共和一个大型工业数据集，我们在实验上表明，最先进的SBRS在稀疏项目的稀疏会议上的性能较低。我们提出了M2TREC，这是一种基于会话建议的元数据感知的多任务变压器模型。我们提出的方法学习了从项目元数据到嵌入的转换函数，因此是免费的（即，不需要学习一个嵌入每个项目）。它集成了项目元数据以学习各种项目属性的共享表示。在推论期间，将为与先前在培训期间观察到的项目共享的属性分配新的或不受欢迎的项目，因此将与这些项目具有相似的表示，从而使甚至冷启动和稀疏项目的建议。此外，M2TREC接受了多任务设置的培训，以预测会话中的下一个项目及其主要类别和子类别。我们的多任务策略使该模型收敛更快，并显着改善了整体性能。实验结果表明，使用我们在两个数据集中稀疏项目上提出的方法进行了显着的性能增长。

基于会话的建议系统在会话中捕获用户的短期兴趣。会话上下文（即，会话中用户在会话中的高级兴趣或意图）在大多数数据集中都没有明确给出，并且隐式推断会话上下文作为项目级属性的汇总是粗略的。在本文中，我们提出了ISCON，该ISCON隐含地将会议上下文化。ISCON首先通过创建会话信息图，学习图嵌入和聚类来为会话生成隐式上下文，以将会话分配给上下文。然后，ISCON训练会话上下文预测器，并使用预测上下文的嵌入来增强下一项目的预测准确性。四个数据集的实验表明，ISCON比最新模型具有优越的下一项目预测准确性。REDDIT数据集中的ISCON的案例研究证实，分配的会话上下文是独特而有意义的。

签名的网络使我们能够对双方的关系和互动进行建模，例如朋友/敌人，支持/反对等。这些交互通常在真实数据集中是暂时的，在这些数据集中，节点和边缘会随时间出现。因此，学习签名网络的动态对于有效预测未来联系的符号和强度至关重要。现有的作品模型签名网络或动态网络，但并非都在一起。在这项工作中，我们研究了动态签名的网络，在这些网络中，链接都随时间签名和演变。我们的模型使用内存模块和平衡聚合（因此，名称SEMBA）学习了签名的链接的演变。每个节点都维护两个单独的内存编码，以实现正相互作用和负相互作用。在新边缘的到来时，每个交互节点汇总了此签名的信息，并利用平衡理论。节点嵌入是使用更新的内存生成的，然后将其用于训练多个下游任务，包括链接标志预测和链接权重预测。我们的结果表明，SEMBA的表现优于所有基准，即通过获得AUC增长8％，而FPR降低了50％。关于预测签名权重的任务的结果表明，SEMBA将平方误差降低了9％，同时降低了KL-Divergence对预测签名权重的分布的减少69％。

预测模型可以表现出对培训数据的敏感性：训练数据中的微小变化可以产生在测试时间期间为单个数据点分配相互矛盾的预测的模型。在这项工作中，我们研究了推荐系统中的这种敏感性，其中用户的建议在其他无关用户的交互中受到较小的扰动的巨大改变。我们介绍了推荐系统的稳定性度量，称为等级列表灵敏度（RLS），该量度衡量了由于培训数据中的扰动而导致的测试时间变化时在测试时间变化时如何生成的等级列表。我们开发了一种方法，即Casper，该方法使用级联效应来识别最小和系统的扰动，以在推荐系统中诱导更高的不稳定性。四个数据集的实验表明，推荐模型对引入或通过Casper引入的次要扰动过于敏感 - 甚至将一个用户的一个随机交互扰动会大大更改所有用户的建议列表。重要的是，借助Casper扰动，这些模型比高准确性的使用者（即那些接受低质量建议的人）为低临界用户（即那些接受低质量建议的人）产生更多的不稳定建议。

在对抗环境中识别有说服力的扬声器是一项关键任务。在全国选举中，政客们希望代表他们有说服力的发言人。当一家公司面临不利的宣传时，他们希望在对他们批评的对手存在的对手存在中，他们希望有说服力的倡导者。辩论代表了这些形式的对抗性劝说的共同平台。本文解决了两个问题：辩论结果预测（DOP）问题预测谁赢得了辩论的争论，而劝说预测强度（IPP）问题预测发言者发言前后投票数量的变化。虽然DOP先前已经研究过，但我们是第一个研究IPP的研究。关于DOP的过去的研究未能利用多模式数据的两个重要方面：1）多种方式通常是语义对齐，而2）不同的方式可以提供用于预测的不同信息。我们的M2P2（多模式说服预测）框架是第一个使用多模式（声学，视觉，语言）数据来解决IPP问题的框架。为了利用不同方式的对准，同时保持所提供的提示的多样性，M2P2设计了一种新的自适应融合学习框架，其保留了从两个模块获得的嵌入式的嵌入式 - 一种对准模块，其提取模态和学习的异构性模块之间的共享信息。具有三种单独培训的单峰参考模型的指导的不同方式的重量。我们在为DOP设计的流行IQ2US数据集中测试M2P2。我们还介绍了一个名为QPS的新数据集（来自QIPASHUO，一个受欢迎的中国辩论电视节目）为IPP。 M2P2显着优于两个数据集上的4个最近基线。

Covid-19的传播引发了针对亚洲社区的社交媒体的种族主义和仇恨。然而，关于种族仇恨在大流行期间的差异和柜台垂直在减轻这种蔓延的角色时，很少见过。在这项工作中，我们研究了通过推特镜头的反亚洲仇恨演讲的演变和传播。我们创建了Covid-讨厌，这是一个跨越14个月的反亚洲仇恨和柜台的最大数据集，含有超过2.06亿推文，以及超过1.27亿节节点的社交网络。通过创建一个新的手工标记数据集，3,355推文，我们培训文本分类器以识别仇恨和柜台jeech推文，以实现0.832的平均宏F1得分。使用此数据集，我们对推文和用户进行纵向分析。社交网络的分析揭示了可恨和柜台的用户互相互动，彼此广泛地互动，而不是生活在孤立的极化社区中。我们发现在暴露于仇恨内容后，节点很可能变得仇恨。值得注意的是，柜台椎间目可能会阻止用户转向仇恨，可能暗示在Web和社交媒体平台上遏制讨厌的解决方案。数据和代码是在http://claws.cc.gatech.edu/covid。

Quadruped robots are currently used in industrial robotics as mechanical aid to automate several routine tasks. However, presently, the usage of such a robot in a domestic setting is still very much a part of the research. This paper discusses the understanding and virtual simulation of such a robot capable of detecting and understanding human emotions, generating its gait, and responding via sounds and expression on a screen. To this end, we use a combination of reinforcement learning and software engineering concepts to simulate a quadruped robot that can understand emotions, navigate through various terrains and detect sound sources, and respond to emotions using audio-visual feedback. This paper aims to establish the framework of simulating a quadruped robot that is emotionally intelligent and can primarily respond to audio-visual stimuli using motor or audio response. The emotion detection from the speech was not as performant as ERANNs or Zeta Policy learning, still managing an accuracy of 63.5%. The video emotion detection system produced results that are almost at par with the state of the art, with an accuracy of 99.66%. Due to its "on-policy" learning process, the PPO algorithm was extremely rapid to learn, allowing the simulated dog to demonstrate a remarkably seamless gait across the different cadences and variations. This enabled the quadruped robot to respond to generated stimuli, allowing us to conclude that it functions as predicted and satisfies the aim of this work.

Searching long egocentric videos with natural language queries (NLQ) has compelling applications in augmented reality and robotics, where a fluid index into everything that a person (agent) has seen before could augment human memory and surface relevant information on demand. However, the structured nature of the learning problem (free-form text query inputs, localized video temporal window outputs) and its needle-in-a-haystack nature makes it both technically challenging and expensive to supervise. We introduce Narrations-as-Queries (NaQ), a data augmentation strategy that transforms standard video-text narrations into training data for a video query localization model. Validating our idea on the Ego4D benchmark, we find it has tremendous impact in practice. NaQ improves multiple top models by substantial margins (even doubling their accuracy), and yields the very best results to date on the Ego4D NLQ challenge, soundly outperforming all challenge winners in the CVPR and ECCV 2022 competitions and topping the current public leaderboard. Beyond achieving the state-of-the-art for NLQ, we also demonstrate unique properties of our approach such as gains on long-tail object queries, and the ability to perform zero-shot and few-shot NLQ.